Learning Coordinated Behaviors for Control of a Simulated Race Car
نویسندگان
چکیده
category: Control, navigation and planning This work is not in submission or press to any other conference. Abstract The demands of rapid response and the complexity of many environments make it diicult to decompose, tune and coordinate re-active behaviors while ensuring consistency. We hypothesize that complex behaviors should be decomposed into separate behaviors resident in separate networks, coordinated through a higher level controller. To explore these issues, we have implemented a neu-ral network architecture as the reactive component of a two layer control system for a simulated race car. By varying the architecture , we tested whether decomposing reactivity into separate behaviors leads to superior overall performance and learning convergence. Based on these results, we further modiied the architecture to produce a race car that is competitive with publicly available solutions.
منابع مشابه
Reinforcement Learning for Coordinated Reactive Control
The demands of rapid response and the complexity of many environments make it diicult to decompose, tune and coordinate reactive behaviors while ensuring consistency. Reinforcement learning networks can address the tuning problem, but do not address the problem of decomposition and coordination. We hypothesize that interacting reactions can often be decomposed into separate control tasks reside...
متن کاملLearning to Race: Experiments with a Simulated Race Car
Experiments with a Simulated Race Car Larry D. Pyeatt Adele E. Howe Colorado State University Fort Collins, CO 80523 email: fpyeatt,[email protected] URL: http://www.cs.colostate.edu/~fpyeatt,howeg Abstract We have implemented a reinforcement learning architecture as the reactive component of a two layer control system for a simulated race car. We have found that separating the layers has ...
متن کاملCoordinating Reactive Behaviors
Combinating reactivity with planning has been proposed as a means of compensating for potentially slow response times of planners while still making progress toward long term goals. The demands of rapid response and the complexity of many environments make it diicult to decompose, tune and coordinate reactive behaviors while ensuring consistency. Neural networks can address the tuning problem, ...
متن کاملBehavior Based Control and Fuzzy Q-learning for Autonomous Mobile Robot Navigation
This paper presents collaboration of behavior based control and fuzzy Q-learning for mobile robot navigation systems. There are many fuzzy Qlearning algorithms that have been proposed to yield individual behavior like obstacle avoidance, find target and so on. However, for complicated tasks, it is needed to combine all behaviors in one control schema using behavior based control. Based this fac...
متن کاملMoNiF: a modular neuro-fuzzy controller for race car navigation
This paper characterizes how well the modular neuro-fuzzy controller, MoNiF, can perform in robotic applications by testing it in a race-car simulator. The performance of this controller is compared with that of a neural network controller (NNC) and the best programmed car (the ideal car). During the phase of learning from the ideal car, MoNiF reaches its stable performance (when it demonstrate...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 1996